ABSTRACT
BACKGROUND: Web-based continuing professional development (CPD) is a convenient and low-cost way for physicians to update their knowledge. However, little is known about the factors that influence their intention to put this new knowledge into practice. OBJECTIVE: We aimed to identify sociocognitive factors associated with physicians' intention to adopt new behaviors as well as indications of Bloom's learning levels following their participation in 5 web-based CPD courses. METHODS: We performed a cross-sectional study of specialist physicians who had completed 1 of 5 web-based CPD courses offered by the Federation of Medical Specialists of Quebec. The participants then completed CPD-Reaction, a questionnaire based on Godin's integrated model for health professional behavior change and with evidence of validity that measures behavioral intention (dependent variable) and psychosocial factors influencing intention (n=4). We also assessed variables related to sociodemographics (n=5), course content (n=9), and course format (eg, graphic features and duration) (n=8). Content variables were derived from CanMEDS competencies, Bloom's learning levels, and Godin's integrated model. We conducted ANOVA single-factor analysis, calculated the intraclass correlation coefficient (ICC), and performed bivariate and multivariate analyses. RESULTS: A total of 400 physicians participated in the courses (range: 38-135 physicians per course). Average age was 50 (SD 12) years; 56% (n=223) were female, and 44% (n=177) were male. Among the 259 who completed CPD-Reaction, behavioral intention scores ranged from 5.37 (SD 1.17) to 6.60 (SD 0.88) out of 7 and differed significantly from one course to another (P<.001). The ICC indicated that 17% of the total variation in the outcome of interest, the behavioral intention of physicians, could be explained at the level of the CPD course (ICC=0.17). In bivariate analyses, social influences (P<.001), beliefs about capabilities (P<.001), moral norm (P<.001), beliefs about consequences (P<.001), and psychomotor learning (P=.04) were significantly correlated with physicians' intention to adopt new behaviors. Multivariate analysis showed the same factors, except for social influences and psychomotor learning, as significantly correlated with intention. CONCLUSIONS: We observed average to high behavioral intention scores after all 5 web-based courses, with some variations by course taken. Factors affecting physicians' intention were beliefs about their capabilities and about the consequences of adopting new clinical behaviors, as well as doubts about whether the new behavior aligned with their moral values. Our results will inform design of future web-based CPD courses to ensure they contribute to clinical behavior change.
ABSTRACT
BACKGROUND: Continuing professional development (CPD) is essential for physicians to maintain and enhance their knowledge, competence, skills, and performance. Web-based CPD plays an essential role. However, validated theory-informed measures of their impact are lacking. The CPD-REACTION questionnaire is a validated theory-informed tool that evaluates the impact of CPD activities on clinicians' behavioral intentions. OBJECTIVE: We aimed to review the use of the CPD-REACTION questionnaire, which measures the impact of CPD activities on health professionals' intentions to change clinical behavior. We examined CPD activity characteristics, ranges of intention, mean scores, score distributions, and psychometric properties. METHODS: We conducted a systematic review informed by the Cochrane review methodology. We searched 8 databases from January 1, 2014, to April 20, 2021. Gray literature was identified using Google Scholar and Research Gate. Eligibility criteria included all health care professionals, any study design, and participants' completion of the CPD-REACTION questionnaire either before, after, or before and after a CPD activity. Study selection, data extraction, and study quality evaluation were independently performed by 2 reviewers. We extracted data on characteristics of studies, the CPD activity (eg, targeted clinical behavior and format), and CPD-REACTION use. We used the Mixed Methods Appraisal Tool to evaluate the methodological quality of the studies. Data extracted were analyzed using descriptive statistics and the Student t test (2-tailed) for bivariate analysis. The results are presented as a narrative synthesis reported according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. RESULTS: Overall, 65 citations were eligible and referred to 52 primary studies. The number of primary studies reporting the use of CPD-REACTION has increased continuously since 2014 from 1 to 16 publications per year (2021). It is available in English, French, Spanish, and Dutch. Most of the studies were conducted in Canada (30/52, 58%). Furthermore, 40 different clinical behaviors were identified. The most common CPD format was e-learning (34/52, 65%). The original version of the CPD-REACTION questionnaire was used in 31 of 52 studies, and an adapted version in 18 of 52 studies. In addition, 31% (16/52) of the studies measured both the pre- and postintervention scores. In 22 studies, CPD providers were university-based. Most studies targeted interprofessional groups of health professionals (31/52, 60%). CONCLUSIONS: The use of CPD-REACTION has increased rapidly and across a wide range of clinical behaviors and formats, including a web-based format. Further research should investigate the most effective way to adapt the CPD-REACTION questionnaire to a variety of clinical behaviors and contexts. TRIAL REGISTRATION: PROSPERO CRD42018116492; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=116492.